Skip to content

feat: Add Krea2OstrisEdit support#1775

Merged
leejet merged 3 commits into
leejet:masterfrom
stduhpf:Krea2OstrisEdit
Jul 11, 2026
Merged

feat: Add Krea2OstrisEdit support#1775
leejet merged 3 commits into
leejet:masterfrom
stduhpf:Krea2OstrisEdit

Conversation

@stduhpf

@stduhpf stduhpf commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds support for Krea2 fine-tunes with editing capabilities trained with https://github.com/ostris/ai-toolkit

Ref: Krea2OstrisEdit

Related Issue / Discussion

N/A

Additional Information

Example:

reference image:
VG

prompt: "a white yeti with horns reading a book that is titled "Ostris + Krea2 Style Reference""

style_reference LoRA: https://huggingface.co/ostris/krea2_turbo_style_reference
(also filter bypasss lora applied to the weights directly)

seed: 9499

master (no image conditioning) No LoRA (with mmproj) No LoRA (without mmproj) style_reference LoRA (with mmproj) style_reference LoRA (without mmproj)
output - Copy (464) output output output - Copy (467) output - Copy (468)

Checklist

@stduhpf

stduhpf commented Jul 10, 2026

Copy link
Copy Markdown
Contributor Author

Bonus: llm-vision only (disabled reference latents for the DiT):

no LoRA style_reference LoRA
output output - Copy (470)

Maybe this could be an option? (what would be the best UI for that?)

@stduhpf

stduhpf commented Jul 10, 2026

Copy link
Copy Markdown
Contributor Author

... and now I find this one, which seems to use different setup:
model: https://huggingface.co/conradlocke/krea2-identity-edit
implentation: https://github.com/lbouaraba/comfyui-krea2edit

  • refs are concatenated before the target image rather than after, but since non-causal attention permutation invarient, I'm pretty sure this doesn't matter as long as the RoPE ids are the same
  • Uses a slightly different prompt format (probably not that important)
  • Does not force timestep=0 for the refs

Just disabling the separate timestep for the refs seems to be enough to make it work pretty well

@leejet leejet merged commit c79d24b into leejet:master Jul 11, 2026
11 checks passed
@leejet

leejet commented Jul 11, 2026

Copy link
Copy Markdown
Owner

Thank you for your contribution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants